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1 Introduction 



i -^h ■ Let F be a finite extension of Q p , with ring of integers O^, and uniformizing parameter w, 

whose residual field has q elements. For G = GL2(-F), let (iri,Vi), (712, V2) and (^3,^3) be 
three irreducible, admissible, infinite dimensional representations of G. Using the theory of 
Gelfand pairs, Dipendra Prasad proves in [P] that the space of G-invariant linear forms on 
V\ V2 V3 has dimension at most one. He gives a precise criterion for this dimension to be 
one, that we will explain now. 

Let Dp be the group of invertible elements of the quaternion division algebra Dp over 
r*"*" ■ F. When (7^, Li) is a discrete series representation of G, denote by (vr^L/) the irreducible 

representation of D* F associated to (7Tj, Vj) by the Jacquet-Langlands correspondence. Again, 
by the theory of Gelfand pairs, the space of Dp-invariant linear forms on V{ V3 has 
■ dimension at most one. 

Let <7j be the two dimensional representations of the Weil-Deligne group of F associated 
to the irreducible representations 7Tj. Lhe triple tensor product u\ <g> 02 03 is an eight 
dimensional symplectic representation of the Weil-Deligne group, and has local root number 
e(o"i o"2 (T3) = ±1. When e{p\ 02 03) = —1, one can prove that the representations 
7Tj's are all discrete series representations of G. 

Theorem 1. (Prasad, Theorem I.4 of [P] ) Let (tti,Vi), (^2, V2); (^3)^3) be three irreducible, 
admissible, infinite dimensional representations of G such that the product of their central 
characters is trivial. If all the representations V% 's are cuspidal, assume that the residue 
characteristic of F is not 2. Then 

. e(<7i o~2 03) = 1 if and only if there exists a non-zero G-invariant linear form on 
Vi V 2 L 3 

. e(o"i o~2 03) = —1 if and only if there exists a non-zero Dt invariant linear form on 

Given a non zero G-invariant linear form i on V\ V2 L3, or a non-zero D^-invariant 
linear form £' on V{ V^' V^', the goal is to find a vector in V\ V2 L3 which is not in the 
kernel of £, or a vector in V( L^' V3 which is not in the kernel of Such a vector is called 
a test vector. At first sight, it appears to have strong connections with the new vectors vx, 
V2 and V3 of the representations 7Ti, tt2 and ^3. 
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Theorem 2. (Prasad, Theorem 1.3 of [P]) When all the 7Tj 's are unramified principal series 
representations of G, v± <8) V2 <8> V3 is a test vector for £. 

Theorem 3. (Gross and Prasad, Proposition 6.3 of [G-P]) When all the tti's are unramified 
twists of the special representation of G : 

. if e(cJi ® o~2 ® 03) = 1, then v± <8) V2 <8> is a £esi vector for £, 

. if e(cri (g) ci2 (8> 03) = — 1, let R' be the unique maximal order in Dp. Then the open 
compact subgroup R'* x R'* x R'* fixes a unique line in V{ ® <8> V3 . Any vector on this line 
is a test vector for £' . 

The proof by Gross and Prasad of the first statement of this theorem actually contains 
another result: 

Theorem 4. When two of the iti 's are unramified twists of the special representation of G 
and the third one belongs to the unramified principal series of G, vi®V2® V3 is a test vector 



But the paper [G-P] gives evidence that v\ <S> V2 <8> ^3 is not always a test vector for £. Let 
K = GL(0p) be the maximal compact subgroup of G. If tt\ and 1T2 are unramified and if tt^ 
has conductor n > 1, £ being G-invariant, v\ and V2 being ^-invariant, one gets a ^-invariant 
linear form 



which must be since 7r3 is ramified. Then £{v\ ®V2® V3) = 0. 

Now Gross and Prasad make the following suggestion. Let I n be the congruence subgroup 



and R be a maximal order M^F) such that R* n K = I n . If v\ is a i?*-invariant vector in 
Vi, the linear form 



is invariant under the action of R* PI K = I n , and one can still hope that v\ ® V2 <8> v% is a test 
vector for £. 

The purpose of this paper is to prove that vl ® f 2 ® W3 actually is a test vector for This 
is the object of Theorem 5. The case n = 1, together with Theorems 2, 3 and 4, complete 
the study of test vectors when the 7Tj's have ramification or 1. 

In the long term, the search for test vectors is motivated by the subconvexity problem for 
L-functions. Roughly speaking, one wants to bound some L-functions along the critical line 
^t(z) = \. A recent and successful idea in this direction has been to relate triple products of 
automorphic forms to special values of L-functions on the critical line. In [B-R 1] and [B-R 2] 
Joseph Bernstein and Andre Reznikov established a so called subconvexity bound the for the 
L-function of a triple of representations : each representation is attached to the eigenvalue of a 
certain operator, and the eigenvalue of one representation varies. Philippe Michel and Akshay 
Venkatesh considered the case when the level of one representation varies. More details about 
subconvexity and those related techniques can be found in [V] or [M-V]. Test vectors are key 
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ingredients. Bernstein and Reznikov use an explicit test vector. Venkatesh uses a theoretical 
one, but explains that the bounds would be better with an explicit one (see paragraph 5 
of [V]). Unfortunately, the difficulty of finding them increases with the ramification of the 
representations involved. 

There is an extension of Prasad's result in [H-S], where Harris and Scholl prove that the 
dimension of the space of G-invariant linear forms on V± <8> V2 <8> V3 is one when n\ , 112 and 7r3 are 
principal series representations, either irreducible or reducible with their unique irreducible 
subspace, infinite dimensional. They apply the global setting of this to the construction of 
elements in the motivic cohomology of the product of two modular curves constructed by 
Beilinson. 

I would like to thank Philippe Michel for suggesting this problem, Wen-Ching Winnie Li 
who invited me to spend one semester at PennState University where I wrote the first draft 
of this paper, and of course Benedict Gross and Dipendra Prasad for the inspiration. I would 
also like to thank Paul Broussous and Nicolas Templier for many interesting discussions, and 
Eric Bahuaud for his help with English. 

In a previous version of this paper, I obtained Theorem 5 under an unpleasant technical 
condition. I am extremely grateful to Maiden Dimitrov, because, thanks to our discussions 
on the subject, I found the way to remove the condition. In [D-N], we are working on a more 
general version of Theorem 5. 



2 Statement of the result 

2.1 About induced and contragredient representations 

Let (p, W) be a smooth representation of a closed subgroup H of G. Let Ah be the modular 
function on H. The induction of p from H to G is a representation ir whose space is the space 
Ind^r (p) of functions / from G to W satisfying the two following conditions : 

(1) V/i€ff, VjeG, f(hg) = A H - l 2(h)p(h)f(g), 

(2) there exists an open compact subgroup Kf of G such that 

Vk€K f , V 9 £G, f(gk) = f(g) 
where G acts by right translation. The resulting function will be denoted {Tr(g), f) that is 

Vg,g eG, <7r(s),/>(so) = /(flofl)- 

With the additional condition that / must be compactly supported modulo H, one gets the 
compact induction denoted by ind H . When G/H is compact, there is no difference between 
Ind^r and ind^-. 

Let B the Borel subgroup of upper triangular matrices in G, and let T be the diagonal 

torus. The character At is trivial and we will use 5 = A# _1 with <^Tq ^ ) = III wriere | • | 

is the normalised valuation of F. The quotient B\G is compact and can be identified with 
P 1 (F). 

For a smooth representation V of G, V* is the space of linear forms on V. The contra- 
gredient representation tt is given by the action of G on V, the subspace of smooth vectors 
in V*. If H is a subgroup of G, V C V\ H C V*. 
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We refer the reader to [B-Z] for more details about induced and contragredient represen- 
tations. 

2.2 New vectors and ramification 

Let (-7T, V) be an irreducible, admissible, infinite dimensional representation of G with central 
character u. To the descending chain of compact subgroups of G 

KDhD---Dl n D I n+1 ■ ■ ■ 

one can associate an ascending chain of vector spaces 

V° = V K and Vn>l, V n = {v G V | G I n , vr((^ b ^j)v = u(a)v }. 

There exists a minimal n such that the vector space V n is not {0}. It is necessarily one 
dimensional and any generator of V n is called a new vector of (ir, V). The integer n is the 
conductor of (ir,V). The representation (tt,V) is said to be unramified when n = 0. Else, it 
is ramified. 

More information about new vectors can be found in [C]. 

2.3 The main result 

Let (7Ti,Vi), (vr2, V2) and (1x3, V3) be three irreducible, admissible, infinite dimensional rep- 
resentations of G such that the product of their central characters is trivial. Assume that 
7Ti and 7T2 are unramified principal series, and that 1x3 has conductor n > 1. According to 
Theorem 1, since ix\ and tx^ are not discrete series, there exists a non-zero, G-invariant linear 
form I on V± <8> V2 <8> V3. We are looking for a vector v in Vi <8> V2 <8> V3 which is not in the 
kernel of £ In order to follow the suggestion of Gross and Prasad we consider 

and R n = 7 - n M 2 (0 F ) 7 ra . 

One can easily check that 

R* n = 7 ~ n K-/ n and R* n n K = I n . 
If v\ , v 2 and denote the new vectors of m , 7T2 and 113 , the vector 

«i = 7Ti(7 _n ) • «i 
is invariant under the action of i?* . Hence we can write 

uj G Vi fi ", w 2 G and t> 3 G V^ 1 " 1 *. 

Theorem 5. Under those conditions, v * ® i>2 £3 U3 is a ies£ vector for I. 

The proof will follow the same pattern as Prasad's proof of Theorem 2 in [P], with the 
necessary changes. 
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3 Going down Prasad's exact sequence 



3.1 Central characters 

Let L0±, u>2 and los be the central characters of 7Ti, 1x2 and ^3. Notice that the condition 
uj\uj2^z = 1 derives from the G-invariance of t. Since tx\ and 7r 2 are unramified, oj\ and u; 2 
are unramified too, and so is W3 because = 1- Let r)i, for i £ {1,2,3} be unramified 

quasi-characters of F* with 77^ = ooi and r/ir/ 2 r/3 = 1. Then 

Vi <g> F 2 ® V 3 ~ (Fi (g> r/f x ) (g> (V 2 ® r/^ 1 ) ® (V3 ® % X ) 

as a representation of G. Hence it is enough to prove Theorem 5 when the central characters 
of the representations are trivial. 

When n = 1, it is also enough to prove Theorem 5 when V3 is the special representation 
Sp of G : take 773 to be the unramified character such that V3 = 773 <8> Sp. 



3.2 Prasad's exact sequence 

Let us now explain how Prasad finds i. It is equivalent to search for t or to search for a 
non-zero element in Homc^Vi ® V2, V3J . Since the central characters of m and 1T2 are trivial, 
there are unramified characters \x\ and /j 2 such that for i = 1 and i = 2 

TT^Lufe With Xi (^ J) 



Hence 



Vx®V 2 = Res G IndS^ ( X i x % 2 



where G is diagonally embedded in GxG for the restriction. The action of G on BxB\GxG = 
F\F) x P X (F) has precisely two orbits. The first is {(u, v) G P X (F) xP^F) | u + v} which 
is open and can be identified with T\G. The second orbit is the diagonal embedding of F 1 (F) 
in P X (F) x P 1 (i ? ), which is closed and can be identified with B\G. Then, we have a short 
exact sequence of G-modules 

ind^(^) ^ Vy ® V 2 m> Indg(xiX2^) 0. (1) 

The surjection res is the restriction of functions from G x G to the diagonal part of 
B\G x B\G, that is 

A B \ G = [(g,bg) I b€B, 

The injection ext takes a function / £ indj^^I^ to a function F € Indg*g^xi x X2^j 
vanishing on A B \ G , and is given by the relation 



*■(,,(; J) ,)-/(,), 

on the other orbit. Applying the functor Hoiiig^- , 1/3^ , one gets a long exact sequence 
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0^Hom G (lndg(xiX2^),V 3 ) - Hom G fa ® F 2 , V3) ^ Hom G (ind£(^-), V3) 

I 

■■■^Ext G (lndg(xiX2^),^) (2) 



3.3 The simple case 
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The situation is easier when n = 1 and /txi// 2 | ■ I 2 = | ■ | 2 , as tts is special and there is a 
natural surjection 

Indg(xix 2 55) — ► V3 

whose kernel is the one dimensional subspace of constant functions. Thanks to the exact 
sequence (1) one gets a surjection \& 

Vi®V 2 ^ Indg(xiX2**) 

V3 

which corresponds to 

e f vi <g> v 2 <g> V3 — ► c 

The surjection ^ vanishes on v£ t>2 if and only if res(vj <S> v 2 ) has constant value on 
F 1 (F) ~ B\G. An easy computation proves that res(t^ <g) v 2 ) is not constant : the new 
vectors v\ and v 2 are functions from G to C such that 

ViG {1,2}, V&e£, VkeK, Vi {bk) = X i{b) ■ S(b)^ 

and 

VgtG, v* 1 (g)=v 1 (gj~ 1 ). 

Then 



m*^)((j !))=*(7>((; !))=*((V !))=«w-'m 



2 



/ii(ro) 



and 



««<!i))-(Gi)(V!))="(G-')(?i))=^ 

The representation 7Ti is principal so —7^- / tl^l an d 



((i!))" w *<!i))- 



Hence \I/ does not vanish on ® v 2 . Now, v* being it^-invariant and v 2 being i^T- invariant, 
^(v* <£>V2) is a non-zero Ii-invariant element of V3, that is, a new vector for 7^3. Consequently 
it does not vanish on V3 : 

£(vl ®v 2 ® v 3 ) = (g> v 2 ).v 3 / 
and v I <8> v 2 <8> ^3 is a test vector for £ 
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3.4 The other case 

If n > 2 or //1//2I " |^ ?H ' then HoniG^Ind^XiX2^^ , V3) = and by Corollary 5.9 of 

Ext^(lndg( X iX2^),F 3 ) =0. 
Through the long exact sequence (2) we get an isomorphism 

Hom G (Vi ®V 2l V 3 )- Hom G (ind£ (g) ,V^j , 

and by Frobenius reciprocity 

Hom G (ind£ (g) , V^j ~ Hom T ((g), V^) , 

where V^y is the space of the contragredient representation of ^3^. By Lemmas 8 and 9 of 
[W], the latter space is one dimensional. Thus, we have a chain of isomorphic one dimensional 
vector spaces 

Hom G (Vi® V 2 ®V 3 ,c) ^ Hom G (Vi ® Vi.Vfc) ^ Hom G (indg(^),^) ^> Hom T ((^), %r) 

£ 1 — > \l/ 1 — > $ 1 — > 

with generators & and <^ corresponding via the isomorphisms. Notice that tp is a linear 
form on V3 such that 

Vt G T, Vv€V 3 , y(^{t)v) = ^-Mv) (3) 
which is identified to the following element of Homr^^j , V^y) 



C — ► V3|t 

2 1 — ► 299 



Lemma 1. <p(w 3 ) / 0. 



Proof : this is Proposition 2.6 of [G-P] with the following translation : 

- the local field F is the same, 

- the quadratic extension K/F of Gross and Prasad is F x F and their group K* is our 
torus T, 

- the infinite dimensional representation V\ of Gross and Prasad is our 713, 

- the one dimensional, unramified representation V2 of Gross and Prasad is ^1. 

Then the representation that Gross and Prasad call V is 0^3 and their condition (1.3) 
is exactly our condition (3). In order to apply Gross and Prasad's Proposition, we need to 
check the equality 

e(a ® 03) = a K/F (-l)u(-l). 

Basically, it is true because K is not a field. Let us give some details. 

- In [G-P], u is the central character of the representation V\ which is trivial for us. 

- The character a^/F ls the quadratic character of F* associated to the extension K/F 
by local class-field theory. Here, it is trivial because K is F x F. 
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- To compute e(a <8> 03) we will use the first pages of [T]. 



v l'S °) 6r S((o ")) = ^ 0< "> = ^0^0*.,) 



Since the determinant of 03 is the central character of which is trivial, <r 3 is isomorphic to 
its own contragredient and the contragredient representation of ^ <8> 03 is ^ <8> (73. Formula 
(1.1.6) of [T] leads to 

e(cr ® 0-3) = det(o- 3 (-l)) = 1 = a K/F (-l)u(-l). 
According to [G-P] , the restriction of ^ <X> 7r3 to the group 

M={(j °) I s.yG OJ.}xJ n 

fixes a unique line in V3 : it is the line generated by the new vector V3. Still according to 
Gross and Prasad, a non-zero linear form on V3 which satisfies (3) cannot vanish on v%. □ 

We will deduce from lemma 1 that £(v* ® V2 <8> ^3) / 0. 

4 Going up Prasad's exact sequence 
4.1 From ^(^3) to / 

Let / be the element of indj^^I^ which is the characteristic function of the orbit of the unit 
in the decomposition of T\G under the action of I n . This means : 

f{g) = [W) ^ 9 = tk With t€ " T ^ kGln (4) 

1 gIsg 

Then, the function 

(G — > C 

[9 1 — ► / (9) <p(ir 3 (g)v3^ 
is invariant by the action of T by left translation and we can do the following computation : 

(*(/)) fa) = f T( f(9)<p(*Mvs)dg 

= I ip[Tr s (k)v 3 )dk 

J(TDK)\I n V ' 

= A • ip{v 3 ). 

where A is a non-zero constant. Thanks to Lemma 1 we know that ip(vs) / 0, so 

'*(/))W/0. (5) 



8 



4.2 From / to F 

Now, we are going to compute F = ext(/) in V\ <g) V^- Let a and 6 be the numbers 



They verify 



(a 2 -l)(6 2 -l)/0 



because 7Ti and 7T2 are principal series representations. For the sake of simplicity, we shall use 
the following notation : for any g in G 



gv\ = {TTi(g),v\J and £w 2 = ( 7T2 (5) , ^2 
Lemma 2. TTie function F is given by the formula 

F = A ■ v[ <g> v' 2 

with 

a n 



A 



(a 2 - 1)(6 2 - 1)' 



v[ = a ■ 7 %i - 7 n t>i 



and 



f 2 = 6 • 7 1 f2 - ^2- 



Proof : the function / is described by formula (4), and ext(/) is described by the short 
exact sequence (1) using the orbits of the action of G on B x B\G x G. The function F must 
vanish on the closed orbit 

A B \ G = [(g,bg) I kS, SEC}. 

The open orbit can be identified with T\G via the bijection 

T\G (5\Gx5\G)\A B \ G 
T, ~ (B 3 ,n(° J),) 

through which, the orbit of the unit in T\G under the action of /„ corresponds to 

{(Bk,B^ I kGl n ). 



Now, pick any (k, k') G K x if. If fc' G Sfc, then 

k e I n < ^=^ fc' G an d k G ii 



When fc' write A; 
that 



2 t 



fc = biko and fc' = 62 



and fc' 



1 

1 



x' y' 
z' f 



=> k' G/i. 
There exists (61,62) £ B x B such 



with h 







z 7 i' 

z t 



G M 2 (C F ). 
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Then (k, k!) is in the orbit of the unit in T\G under the action of I n if and only if k$ is in 
TI n . Because k and k! are in K, one can see that 

k G TI n k G I n 

and 

ko G I n z = modw n and z't G 0* F 

<=^ z = modw n and z' G Op 
-4=>- k £ I n and fc' ^ Ji. 



It follows that (fc, k') corresponds to an element of the orbit of the unit in the decomposi- 
tion of T\G under the action of I n if and only if k G I n and k' £ I\. Then, it will be enough 
to check that 

1 if k G I n and k! 1\ ^ 



F(k,k') 



else 



This is mere calculation. With a = , we need 

Lemma 3. Let i be any element o/N. The values of the function ^~ % v\ on K are given by 
the formula 



Vk 



x y 
z t 



i if val(f ) < 

G K, 7 _i ui(fc) = { a'- 2val (f ) if 1 < val(f ) < % - 1 

1"* if i < val(f ) 

Proo/ : first, recall that the new vector i^is a function from G to C such that 
VkB, Vfc G K, vi (bk) = X i (6) ■ 6(b) i 



Then, for 



z t 



in if, either z or i is in 0* F . The other one is in Of. Write 



(7) 



kj~ l = 



If val § < 0, then valz = 0, val(^) > and 



—i V 

TO 1 a 
—I t 



kj~ l = 



xt—yz x 



z 





z 

zu>- 



with 



'0 -1 



G K and (xi ■ 5 7 < 



xt—yz x 



-H 

TO 1 



-1 



- 2val z 



a 'i—2valz i 
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If 1 < val | < i — 1, then vali = 0, val(^) > and the computation is quite the same, 
except that 



If i < val f , then valt = 0, val(^) < and 



&7~ 

with 



4=^ y\ / 1 



t It^t 1 



□ 



NB : the case £ = is included in val | < 0. 



We can now finish the proof of Lemma 2. The same computation, with V2 and b instead 
of v\ and a, gives the values of 7~ l ^2 for any t £ N. It is then easy to compute F(k, k') as 
given in Lemma 2, for k and k' in K, and to check formula (6). 

4.3 Some test-vectors 

On the one hand, from the expression of F given by Lemma 2 we deduce 

'■V(F)) (v 3 ) = A ■ ® v' 2 <g> v 3 ) 



On the other hand, from the relation F = ext(/) we deduce 

= (*(/)) M 

and from equation 5 in Section 4.1 we get 

(tf(F))(«3)^0 

Then 

£(v[ <S> v' 2 <S> v 3 ) / 

and ® ^2 ® «3 is a test vector for £. We are going to simplify it. We can deduce from lemma 
2 that 

F = A ■ |a6 • 7~( n ~%i <g> r y~ 1 v 2 - a ■ 7~(™~% 1 <g> v 2 - b ■ 7 _ri «i <8> 7 _1 t>2 + 7~ n fi ® w 2 | . 
If n > 2, we write 

(*(F))(«3) = A - (a6- (7 _ Vn-2,«3) - O- <^n-l,«3> - <7"Vn-l,U3) + W'n.VS}) 



where, for m in {n — 1, n — 2, n} 



V 3 — c 
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Since £ is G invariant, ip m is an element of V3 which is invariant by the action of 

R m n K = I m 

But 7F3 has conductor n so 

V>n-2 = i>n-l = 

and 

(v(F)) (v 3 ) = A ■ 4> 3 (v 3 ) = A ■ £(j- n Vl ®v 2 ® v 3 ) 

then 

£{l~ n v 1 <8 v 2 <8) v 3 ) 7^ 
and 7~ n vi ® f 2 <8> v 3 is a test vector for 

If n = 1, only the two terms in the middle vanish and we get 
(tf(F))(« 3 ) =A - (a&- 

07 1 t>2 (8> V3) + ^(7 ^ 1 <8> ^2 (8> ^3)) 

Now, take 

9 



On the one hand 

and this matrix is in K so 
On the other hand 



91 1 



1 

ZD 



1 

1 



91 1 vi = vi 



w ~ { w ) { 1/U 



The first matrix belongs to the center of G, the second one is precisely 7 1 and the third one 
is in K, so 



gV2 = 7 1 W2 . 



Then 

v\ <8 gv 2 (8 U3) + ^(7 <8 «2 <8 ^3)} 
=^4 • {a& • £(j~ 1 v\ (8 ^2 <8 <7 -1 t>3) + ^(7~ 1 fi (8> ^2 ® 1*3)} 
=^ • £(7~V t» 2 (8> u 3 ) 



with 

v' 3 = ab- (flT 1 ^) + t>3 

The linear form 

\ v 1 — ► £( , y~ 1 vi (8 f2 <8 w) 
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is a non zero element of V3 \ so it is a new vector in V3. It is known from [B] that a new 
vector in V3 does not vanish on on V^ 1 that is, it does not vanish on a new vector of V3 : 

£(^ 1 vi <8> -U2 ® U3) / 

and 7 _1 ui <8> u 2 ® ^3 is a test vector for I. This concludes the proof of Theorem 5. 



NB : it is easy to deduce from Theorem 5 that v\ ® 7 <8> W3 also is a test vector for I. 
Take 

A 

w n 
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Then 



n vi =vi , gv 2 = j n v 2 

and 

l{v\ <8> 7~ n f2 (8> gv-i) = l(g r )~ n v\ ® gv 2 <8> 5^3) = £(7 _ ™wi (8> «2 <8> ^3) / 0. 
So the linear form 

(V 3 — C 

I w 1 — ► ® r y~ n v 2 <8> f ) 

is not zero. Being I n -invariant, it is a new vector in V3, which does not vanish on V3 : 

£(vi <8> 7 _n f 2 <8> V3) / 0. 
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